Improved MinMax Cut Graph Clustering with Nonnegative Relaxation
نویسندگان
چکیده
In graph clustering methods, MinMax Cut tends to provide more balanced clusters as compared to Ratio Cut and Normalized Cut. The traditional approach used spectral relaxation to solve the graph cut problem. The main disadvantage of this approach is that the obtained spectral solution has mixed signs, which could severely deviate from the true solution and have to resort to other clustering methods, such as K-means, to obtain final clusters. In this paper, we propose to apply additional nonnegative constraint into MinMax Cut graph clustering and introduce novel algorithms to optimize the new objective. With the explicit nonnegative constraint, our solutions are very close to the ideal class indicator matrix and can directly assign clusters to data points. We present efficient algorithms to solve the new problem with the nonnegative constraint rigorously. Experimental results show that our new algorithm always converges and significantly outperforms the traditional spectral relaxation approach on ratio cut and normalized cut.
منابع مشابه
Orthogonal and Nonnegative Graph Reconstruction for Large Scale Clustering
Spectral clustering has been widely used due to its simplicity for solving graph clustering problem in recent years. However, it suffers from the high computational cost as data grow in scale, and is limited by the performance of post-processing. To address these two problems simultaneously, in this paper, we propose a novel approach denoted by orthogonal and nonnegative graph reconstruction (O...
متن کاملBeyond Spectral Clustering - Tight Relaxations of Balanced Graph Cuts
Spectral clustering is based on the spectral relaxation of the normalized/ratio graph cut criterion. While the spectral relaxation is known to be loose, it has been shown recently that a non-linear eigenproblem yields a tight relaxation of the Cheeger cut. In this paper, we extend this result considerably by providing a characterization of all balanced graph cuts which allow for a tight relaxat...
متن کاملConvergence and Energy Landscape for Cheeger Cut Clustering
This paper provides both theoretical and algorithmic results for the `1-relaxation of the Cheeger cut problem. The `2-relaxation, known as spectral clustering, only loosely relates to the Cheeger cut; however, it is convex and leads to a simple optimization problem. The `1-relaxation, in contrast, is non-convex but is provably equivalent to the original problem. The `1-relaxation therefore trad...
متن کاملA Feature Space View of Spectral Clustering
The transductive SVM is a semi-supervised learning algorithm that searches for a large margin hyperplane in feature space. By withholding the training labels and adding a constraint that favors balanced clusters, it can be turned into a clustering algorithm. The Normalized Cuts clustering algorithm of Shi and Malik, although originally presented as spectral relaxation of a graph cut problem, ca...
متن کاملSurvey of Clustering Methods and Related Seeding Techiniques
We try to extend the seeding technique proposed in [2],to the spectral clustering domain.We start with the survey of a sequence of papers on the connection between spectral clustering techniques and centroid-based algorithms. We show that the results in [2] can provide a bound for the rounding of the normalized cut problem. This raises an interesting question on the relationship between the see...
متن کامل